Multi-agent State Estimation
نویسنده
چکیده
The knowledge about its operation environment is a fundamental requirements for intelligents agents acting in a dynamic world. Knowledge gathering is thus a critical functionality for any agents and it involves several problems: perception, object detection, environment structure reconstruction and so on. The state estimation problem is a general definition to describe many applications: object tracking, localization, mapping, exploration. The core concept is that the agent has to operate in an environment, basing its actions on what it thinks about the environment. The “state estimation problem” has this goal: given some kind of sensations, it reconstructs a model of the world. Sometimes an agent can have an idea “a priori” about how its world is made. But often it does not know anything and has to also build a model on data. While a lot of researches has been done in the past about single-agent state estimation problem, in recent years, a lot of reserchers focused their attention about exploiting state estimation technique using multiple agents. Using several agents gives more challenging questions. For example, should agents share their own informations or not? How deal with communication problems? And what about scalability of methods? All of the state-of-the-art approches virtually use Bayes filter. This choice is necessary because using agents based on unreliable sensors, that gives uncertain measurements, we could easily have unbounded error solutions. This paper is structured as follow. In Section 2.1 we first describe a general bayesian framework, and we describe two of most used techniques: the Kalman filter and the particle filter. Next, in Section, 3 we present an overview of state-of-the-art approaches, from centralized methods, that use a single node to gathering information, to distributed platforms, that use instead the capabilities of distributed computation. Finally in Section 4 we point out some interesting results in current devoloping architecture.
منابع مشابه
Multi-Area State Estimation Based on PMU Measurements in Distribution Networks
State estimation in the energy management center of active distribution networks has attracted many attentions. Considering an increase in complexity and real-time management of active distribution networks and knowing the network information at each time instant are necessary. This article presents a two-step multi-area state estimation method in balanced active distribution networks. The prop...
متن کاملMulti-objective Measurement Devices Allocation Using State Estimation in Distribution System
Allocation of measurement devices is a necessity of distribution system which is an application of state estimation. In this paper, the problem of active and reactive measurement devices is modeling using a multi-objective method. The objectives of the problem are to minimize the use of measurement devices, increase in state estimation output, improve the state estimation quality and reduce cos...
متن کاملUtilizing Generalized Learning Automata for Finding Optimal Policies in MMDPs
Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...
متن کاملComplexity management in the state estimation of multi-agent systems
This work addresses the problem of estimating the state in multi-agent decision and control systems. In particular, a novel approach to state estimation is developed that uses partial order theory in order to overcome some of the severe computational complexity issues arising in multi-agent systems. Within this approach, state estimation algorithms are developed, which enjoy proved convergence ...
متن کاملState Estimation in Multi-agent Decision and Control Systems
This thesis addresses the problem of estimating the state in multi-agent decision and control systems. In particular, a novel approach to state estimation is developed that uses partial order theory in order to overcome some of the severe computational complexity issues arising in multi-agent systems. Within this approach, state estimation algorithms are developed that enjoy provable convergenc...
متن کاملA reinforcement learning scheme for a multi-agent card game with Monte Carlo state estimation
This article presents the state estimation method based on Monte Carlo sampling in a partially observable situation. We formulate an automatic strategy acquisition problem for the multi-agent card game “Hearts” as a reinforcement learning (RL) problem. Since there are often a lot of unobservable cards in this game, RL is dealt with in the framework of a partially observable Markov decision proc...
متن کامل